Increasing trust through the design of algorithm-based lesion segmentation support systems

The adoption rate of algorithm-based lesion segmentation support systems in clinical practice is very low. This is partly due to low trust levels radiologists have in such systems. To increase the trust, the design and validation of the support tools must comply with the needs and expectations of radiologists. We interviewed four clinicians who work with brain images on a daily basis to understand the needs, current methods and practices of image interpretation, and their opinion of automatic brain lesion segmentation tools. In the interviews, we identified the necessity to state the error of the automated decision support tool and its clinical relevance in a given context

Comparison of Two-Dimensional- and Three-Dimensional-Based U-Net Architectures for Brain Tissue Classification in One-Dimensional Brain CT

Brain tissue segmentation plays a crucial role in feature extraction, volumetric quantification, and morphometric analysis of brain scans. For the assessment of brain structure and integrity, CT is a non-invasive, cheaper, faster, and more widely available modality than MRI. However, the clinical application of CT is mostly limited to the visual assessment of brain integrity and exclusion of copathologies. We have previously developed two-dimensional (2D) deep learning-based segmentation networks that successfully classified brain tissue in head CT. Recently, deep learning-based MRI segmentation models successfully use patch-based three-dimensional (3D) segmentation networks. In this study, we aimed to develop patch-based 3D segmentation networks for CT brain tissue classification. Furthermore, we aimed to compare the performance of 2D- and 3D-based segmentation networks to perform brain tissue classification in anisotropic CT scans. For this purpose, we developed 2D and 3D U-Net-based deep learning models that were trained and validated on MR-derived segmentations from scans of 744 participants of the Gothenburg H70 Cohort with both CT and T1-weighted MRI scans acquired timely close to each other. Segmentation performance of both 2D and 3D models was evaluated on 234 unseen datasets using measures of distance, spatial similarity, and tissue volume. Single-task slice-wise processed 2D U-Nets performed better than multitask patch-based 3D U-Nets in CT brain tissue classification. These findings provide support to the use of 2D U-Nets to segment brain tissue in one-dimensional (1D) CT. This could increase the application of CT to detect brain abnormalities in clinical settings

Automatic volumetry on MR brain images can support diagnostic decision making.

Background: Diagnostic decisions in clinical imaging currently rely almost exclusively on visual image interpretation. This can lead to uncertainty, for example in dementia disease, where some of the changes resemble those of normal ageing. We hypothesized that extracting volumetric data from patients MR brain images, relating them to reference data and presenting the results as a colour overlay on the grey scale data would aid diagnostic readers in classifying dementia disease versus normal ageing. Methods: A proof-of-concept forced-choice reader study was designed using MR brain images from 36 subjects. Images were segmented into 43 regions using an automatic atlas registration-based label propagation procedure. Seven subjects had clinically probable AD, the remaining 29 of a similar age range were used as controls. Seven of the control subject data sets were selected at random to be presented along with the seven AD datasets to two readers, who were blinded to all clinical and demographic information except age and gender. Readers were asked to review the grey scale MR images and to record their choice of diagnosis (AD or non-AD) along with their confidence in this decision. Afterwards, readers were given the option to switch on a false-colour overlay representing the relative size of the segmented structures. Colorization was based on the size rank of the test subject when compared with a reference group consisting of the 22 control subjects who were not used as review subjects. The readers were then asked to record whether and how the additional information had an impact on their diagnostic confidence. Results: The size rank colour overlays were useful in 18 of 28 diagnoses, as determined by their impact on readers diagnostic confidence. A not useful result was found in 6 of 28 cases. The impact of the additional information on diagnostic confidence was significant (p < 0.02). Conclusion: Volumetric anatomical information extracted from brain images using automatic segmentation and presented as colour overlays can support diagnostic decision making. © 2008 Heckemann et al; licensee BioMed Central Ltd.Published versio

On brain atlas choice and automatic segmentation methods: a comparison of MAPER & FreeSurfer using three atlas databases

Several automatic image segmentation methods and few atlas databases exist for analysing structural T1-weighted magnetic resonance brain images. The impact of choosing a combination has not hitherto been described but may bias comparisons across studies. We evaluated two segmentation methods (MAPER and FreeSurfer), using three publicly available atlas databases (Hammers_mith, Desikan-Killiany-Tourville, and MICCAI 2012 Grand Challenge). For each combination of atlas and method, we conducted a leave-one-out cross-comparison to estimate the segmentation accuracy of FreeSurfer and MAPER. We also used each possible combination to segment two datasets of patients with known structural abnormalities (Alzheimer's disease (AD) and mesial temporal lobe epilepsy with hippocampal sclerosis (HS)) and their matched healthy controls. MAPER was better than FreeSurfer at modelling manual segmentations in the healthy control leave-one-out analyses in two of the three atlas databases, and the Hammers_mith atlas database transferred to new datasets best regardless of segmentation method. Both segmentation methods reliably identified known abnormalities in each patient group. Better separation was seen for FreeSurfer in the AD and left-HS datasets, and for MAPER in the right-HS dataset. We provide detailed quantitative comparisons for multiple anatomical regions, thus enabling researchers to make evidence-based decisions on their choice of atlas and segmentation method

Framing image registration as a landmark detection problem for better representation of clinical relevance

Nowadays, registration methods are typically evaluated based on sub-resolution tracking error differences. In an effort to reinfuse this evaluation process with clinical relevance, we propose to reframe image registration as a landmark detection problem. Ideally, landmark-specific detection thresholds are derived from an inter-rater analysis. To approximate this costly process, we propose to compute hit rate curves based on the distribution of errors of a sub-sample inter-rater analysis. Therefore, we suggest deriving thresholds from the error distribution using the formula: median + delta * median absolute deviation. The method promises differentiation of previously indistinguishable registration algorithms and further enables assessing the clinical significance in algorithm development

Automatic morphometry in Alzheimer's disease and mild cognitive impairment.

Accepted versio

CT-based volumetric measures obtained through deep learning: Association with biomarkers of neurodegeneration

INTRODUCTION: Cranial computed tomography (CT) is an affordable and widely available imaging modality that is used to assess structural abnormalities, but not to quantify neurodegeneration. Previously we developed a deep-learning–based model that produced accurate and robust cranial CT tissue classification. // MATERIALS AND METHODS: We analyzed 917 CT and 744 magnetic resonance (MR) scans from the Gothenburg H70 Birth Cohort, and 204 CT and 241 MR scans from participants of the Memory Clinic Cohort, Singapore. We tested associations between six CT-based volumetric measures (CTVMs) and existing clinical diagnoses, fluid and imaging biomarkers, and measures of cognition. // RESULTS: CTVMs differentiated cognitively healthy individuals from dementia and prodromal dementia patients with high accuracy levels comparable to MR-based measures. CTVMs were significantly associated with measures of cognition and biochemical markers of neurodegeneration. // DISCUSSION: These findings suggest the potential future use of CT-based volumetric measures as an informative first-line examination tool for neurodegenerative disease diagnostics after further validation

Classification and Lateralization of Temporal Lobe Epilepsies with and without Hippocampal Atrophy Based on Whole-Brain Automatic MRI Segmentation

Brain images contain information suitable for automatically sorting subjects into categories such as healthy controls and patients. We sought to identify morphometric criteria for distinguishing controls (n = 28) from patients with unilateral temporal lobe epilepsy (TLE), 60 with and 20 without hippocampal atrophy (TLE-HA and TLE-N, respectively), and for determining the presumed side of seizure onset. The framework employs multi-atlas segmentation to estimate the volumes of 83 brain structures. A kernel-based separability criterion was then used to identify structures whose volumes discriminate between the groups. Next, we applied support vector machines (SVM) to the selected set for classification on the basis of volumes. We also computed pairwise similarities between all subjects and used spectral analysis to convert these into per-subject features. SVM was again applied to these feature data. After training on a subgroup, all TLE-HA patients were correctly distinguished from controls, achieving an accuracy of 96 ± 2% in both classification schemes. For TLE-N patients, the accuracy was 86 ± 2% based on structural volumes and 91 ± 3% using spectral analysis. Structures discriminating between patients and controls were mainly localized ipsilaterally to the presumed seizure focus. For the TLE-HA group, they were mainly in the temporal lobe; for the TLE-N group they included orbitofrontal regions, as well as the ipsilateral substantia nigra. Correct lateralization of the presumed seizure onset zone was achieved using hippocampi and parahippocampal gyri in all TLE-HA patients using either classification scheme; in the TLE-N patients, lateralization was accurate based on structural volumes in 86 ± 4%, and in 94 ± 4% with the spectral analysis approach. Unilateral TLE has imaging features that can be identified automatically, even when they are invisible to human experts. Such morphometric image features may serve as classification and lateralization criteria. The technique also detects unsuspected distinguishing features like the substantia nigra, warranting further study

Macroanatomy and 3D Probabilistic Atlas of the Human Insula

International audienceThe human insula is implicated in numerous functions. More and more neuroimaging studies focus on this region, however no atlas offers a complete subdivision of the insula in a reference space. The aims of this study were to define a protocol to subdivide insula, to create probability maps in the MNI152 stereotaxic space, and to provide normative reference volume measurements for these subdivisions. Six regions were manually delineated bilaterally on 3D T1 MR images of 30 healthy subjects: the three short gyri, the anterior inferior cortex, and the two long gyri. The volume of the insular grey matter was 7.7 ± 0.9cm3 in native space and 9.9 ± 0.6cm3 in MNI152 space. These volumes expressed as a percentage of the ipsilateral grey matter volume were minimally larger in women (2.7±0.2%) than in men (2.6±0.2%). After spatial normalization, a stereotactic probabilistic atlas of each subregion was produced, as well as a maximum-probability atlas taking into account surrounding structures. Automatically labelling insular subregions via a multi-atlas propagation and label fusion strategy (MAPER) in a leave-one-out experiment showed high spatial overlaps of such automatically defined insular subregions with the manually derived ones (mean Jaccard index 0.65, corresponding to a mean Dice index of 0.79), with an average mean volume error of 2.6%. Probabilistic and maximum probability atlases and the original delineations are available on the web under free academic licences